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Abstract 


Two  classes  of  finite  and  infinite  moving  average  sequences  of  bivariate 
random  vectors  are  considered.  The  first  class  has  bivariate  exponential  mar¬ 
ginals  while  the  second  class  has  bivariate  geometric  marginals.  The  theory  of 
positive  dependence  is  used  to  show  that  in  various  cases  the  two  classes  consist 
of  associated  random  variables.  Association  is  then  applied  to  establish  moment 
inequalities  and  to  obtain  approximations  to  some  joint  probabilities  of  the 
bivariate  processes. 
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Key  Words:  bivariate  exponential  and  geometric  distributions,  association, 
bivariate  moving  averages  and  bivariate  point  processes. 


1.  Introduction  and  Summary 

A  primary  stationary  model  in  time  series  analysis  is  the  p*l  moving  average 
(MA)  model  given  by: 


(1.1) 


X(n)  “  Ij«_»  A(j)e(n-j),  n  =  0,+l,+2, . . . , 


where  A(j),  j  =  0,+l,+2 .  is  a  sequence  cf  pxp  parameter  matrices  such  that 

II.  „  I|A(J)||  <=°,  and  e  (n) ,  n  =  0,+l,+2 .  is  a  sequence  of  uncorrelated  p*l  random 

J — 00 

vectors  with  mean  zero  and  common  covariance  matrix.  It  is  well  known  that  this 
model  emerges  from  many  physically  realizable  systems  (see,  for  example,  Hannan 
(1970),  p.  9).  However,  in  some  physical  situations  where  the  random  vectors  X(n) 
are  either  positive  or  discrete,  the  preceeding  assumptions  on  the  t (n)  sequence  are 
inappropriate  (see  Lewis  (1980),  p.  152). 

Several  researchers,  addressing  themselves  to  this  problem,  have  been  con¬ 
structing  univariate  stationary  MA  models  and  univariate  stationary  autoregressive 
moving  average  (ARMA)  models  where  the  random  variables  X(n)  have  exponential 
or  gamma  distributions,  and  discrete  models  where  X(n)  assumes  values  in  a  common 
set.  Lawrance  and  Lewis  (1977,  1980)  present  stationary  MA  models  where  the 
random  variables  X(n)  have  exponential  distributions;  Gaver  and  Lewis  (1980) 
consider  stationary  ARMA  type  models  where  the  random  variables  X(n)  have  gamma 
distributions.  Jacobs  and  Lewis  (1978a, b,  1983)  construct  ARMA  type  models  where 
the  random  variables  X(n)  are  discrete  and  assume  values  in  a  common  finite  set. 

The  aforementioned  models  have  been  used  in  the  various  fields  of  applied  prob¬ 
ability  and  time  series  analysis,  for  example,  these  models  have  been  used  to 
model  and  analyze  univariate  point  processes  with  correlated  service  and  correlated 
interarrival  times  (see  Jacobs  (1978)).  Details  concerning  univariate 
geometric  MA  processes  and  the  corresponding  point  processes  may  be  found  in 
Langberg  and  Stoffer  (1985). 
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In  this  paper  we  present  two  classes  of  finite  and  infinite  MA  sequences 
of  bivariate  random  vectors.  The  first  class  has  exponential  marginals  while 
the  second  class  has  geometric  marginals.  Within  each  class  of  models,  the  se¬ 
quences  are  classified  according  to  their  order  of  dependence  on  the  past.  For 
the  sake  of  clarity  we  restrict  ourselves  to  bivariate  MA  sequences.  However 
these  models  can  be  extended  in  a  straight  forward  way.  We  use  the  theory  of 
positive  dependence  to  show  that  in  a  variety  of  cases  the  two  classes  of  MA 
sequences  are  associated.  We  then  apply  the  association  to  establish  some  moment 
and  probability  inequalities. 

In  Section  2  we  define  the  bivariate  exponential  and  geometric  distributions 
which  are  the  underlying  distributions  of  our  two  classes,  and  present  a  variety 
of  examples  of  such  distributions.  Further  in  Section  2  we  define  the  concept  of 
association  and  present  a  variety  of  bivariate  exponential  and  geometric  distribu¬ 
tions  that  are  associated.  In  Section  3  we  construct  the  two  classes  of  MA 
sequences  proving  that  they  have  exponential  or  geometric  marginals  and  showing 
that  if  the  underlying  distribution  is  associated,  so  is  the  related  MA  sequence. 
Finally  in  Section  3  we  present  the  autocovariance  matrices 

for  both  classes  of  sequences.  In  Section  4  we  indicate  how  to  relate  bivariate 
point  processes  to  the  bivariate  exponential  or  geometric  MA  processes  discussed 
in  Section  3.  Also,  in  Section  4  we  utilize  positive  dependence  properties 
to  obtain  some  probability  bounds  and  moment  inequalities  for  the  bivariate  processes 

2,  Preliminaries 

In  this  section  we  present  definitions  and  prove  some  basic  results  to  be 
used  in  the  sequel.  First,  we  present  a  definition  of  a  bivaraite  geometric 
distribution. 

Definition  2.1.  Let  M,N  be  random  variables  assuming  values  in  the  set  {1,2,...}. 
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We  say  that  (M,N)  has  a  bivariate  geometric  distribution  if  M  and  N  have  goemetric 
distributions. 

Examples  2.2.  (a)  Let  N  be  geometric.  Then  (U,N)  is  bivariate  geometric. 

(b)  Let  M  and  N  be  independent  geometric  random  variables,  then  (M,N)  is  bivariate 
geometric.  (c)  Let  Ni*N2,N3  independent  geometric  random  variables,  and  put 
M  =  (min(N1,N3) } ,  N  =  {min(N2 ,N3) } .  Then  (M,N)  has  the  Esary-Mar shall  (1974)  bi¬ 
variate  geometric  distribution.  (d)  Let  PQ0’P01 ,P10*Pll  in  such  that 

(i)  p00+Poi+PlO+Pll=  Poi+Pn<  ^  anc^  Pjo+Pn  <  ^ *  an<*  *et  M*  N  be  random  var¬ 

iables  assuming  values  in  the  set  {1,2,,..}  determined  by: 


(2.3) 


P(M >  a,  N  >  b) 


pu‘poi+pn)b'a-  bia- 


puiPio+pn,a'b-  bia- 


Then  (M,N)  has  the  Block  (1977)  fundamental  bivariate  geometric  distribution 

(see  also  Block  and  Paulson  (1984)),  (e)  Let  (M^,!^)  be  bivariate  geometric  and 

let  (N  (j),N  (j)),  j=  1,2,.,,,  be  an  iid  sequence  of  random  vectors  with  bivariate 

M1  M2 

geometric  distributions  which  are  independent  of  (M^,!^),  Then  Q j_^N^( j ) ,7  3N2( j ) ) 

has  a  bivariate  geometric  distribution. 

In  the  following  remark  we  show  that  Examples  2.2a,  2,2b,  2,2c,  but  not  2 . 2e , 
are  particular  cases  of  Example  2. 2d, 

Remarks  2.4.  (a)  Let  P^q  =  Pq^=  ®  *n  equation  (2.3).  Then  we  obtain  the  dis¬ 
tribution  introduced  in  Example  2,2a.  (b)  Let  P^3  =  (P^j+P^q) (P^j+Pq^)  ^  • 

Then  we  obtain  the  bivariate  geometric  distribution  introduced  in  Example  2.2b. 

(c)  Let  P^3  >_  (P  j+P^  ) (P^j+Pq^)  (2,3)  and  let  N3,N2,N3  be  independent  geometric 

random  variables  with  parameters  p11(pil+p10)  1,  Pn(Pii+Poi^  ^  >  Pl  1  ^Pll+P10'>  ^P1 1+P01  ^ 
respectively.  Put  M  =  (mintN^.N-j)}  and  N  =  {min(N2 , N3) } .  Then  (M,N)  is  stochas¬ 
tically  equal  to  the  Esa ry-Ma rsha 1 1  bivariate  geometric  distribution  given  in 


Example  2.2c. 


u 


Next,  we  present  a  definition  of  a  bivariate  exponential  distribution. 
Definition  2.5  Let  E^.E^  '3e  random  variables  assuming  values  in  (0,®).  We  say 
that  (E^.E^)  has  a  bivariate  exponential  distribution  if  E^  and  E^  have  exponential 
distributions . 

Examples  2.6  (a)  Let  E  be  exponential.  Then  (E,E)  is  bivariate  exponential. 

(b)  Let  E^.Ej  independent  exponentials.  Then  (E^,E^)  has  a  bivariate  ex¬ 
ponential  distribution.  (c)  Let  X^,X2,X^  be  independent  exponentials  and  put 
E^  =  {min(X^ ,X^) ) ,  E^  =  {min(X2 ,X^) } .  Then  (E^.E^)  has  the  Marshall-Olkin  (1967) 
bivariate  exponential  distribution.  (d)  Let  (M,N)  have  a  bivariate  geometric 
distribution  and  let  (E^( j ) .E^Cj )) ,  j=l,2,...,  be  an  iid  sequence  of  random 

vectors  with  bivariate  exponential  distributions,  independent  of  M  and  N.  Then 
rM  rN 

(>  ^E^(j),  2.  j  =  1^2 ( J ^  ^  has  a  bivariate  exponential  distribution.  (e)  Let 

0<_o<_l.  Then  (E^,E2>  determined  by  P{E1>x,  E2>y)  =  exp{-x-y-axy } ,  x,y>0, 

has  a  Gumbel  (1960)  bivariate  exponential  distribution,  (f)  Let  ]a]<_  1. 

Then  (E^.E^)  determined  by  P{E^<^i,  E^y}  =  (1-e  X)(l-e  y)(l+ae  X  y)  ,  x,y>  0, 

has  a  bivariate  Gumbel  (1960)  exponential  distribution.  (g)  Let  ct>_l.  Then 

-(xa+Va)1/a 

(E^.E^)  determined  by  P{E^ >  x,  >  y}  =  e  J  ,  x,y>  0,  is  bivariate  expo¬ 

nential.  (h)  Let  (X,Y)  be  a  random  vector  with  continuous  marginal  distributions 
F  and  G,  respectively.  Then  the  random  vector  (-ln[ l-F(X) ] ,  -ln[l-G(Y)])  is  bi¬ 
variate  exponential. 

Example  2.6(d)  has  been  used  by  several  researchers  to  generate  bivariate 
distributions  (for  example  Arnold  (1975),  Downton  (1970),  and  Hawkes  (1972) 


to  mention  a  few).  In  the  following  remarks  we  illustrate  how  some  of  the  bi¬ 
variate  exponential  distributions  are  obtained  from  Example  2.6(d). 

Remarks  2.7.  (a)  M  =  N  and  let  E^(j),  E ^ ( j )  be  independent  exponentials, 

j=  1,2,...  .  Then  we  obtain  the  distribution  introduced  by  Downton  (1970). 

(b)  Let  (M,N)  be  as  in  Example  2.2(d)  and  let  E^(j),  E^tj)  be  independent  exponen¬ 
tials,  j=  1,2,....  Then  we  obtain  the  bivariate  exponential  distribution  intro¬ 
duced  by  Hawkes  (1972)  and  Paulson  (1973).  (c)  Let  ( M , N )  be  as  in  Example  2.2(c) 
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and  let  E ^ ( j )  =  E ^ ( j ) *  j=  1,2,...,  Then  we  obtain  the  Marshall-Olkin  (1967) 

distribution  given  in  Example  2.6(c)  (for  details  see  Marshall-Olkin  (1967)). 

Finally  we  present  a  concept  of  positive  dependence. 

Definition  2.8  Let  T=  (T„,...,T  ),  n=  1,2,...,  be  a  multivariate  random  vector. 
-  __  \  n 

We  say  that  the  random  variables  T^»...»Tn  are  associated  if  for  all  pairs  of 
measurable  bounded  functions  f,g:  Rn-*  R  both  nondecreasing  in  each  argument 
cov(f(T),g(T)) >  0. 

Remarks  2.9.  (a)  Note  that  independent  random  variables  are  associated  and 

that  nondecreasing  functions  of  associated  random  variables  are  associated  (cf. 

Barlow  and  Proschan  (1975)  pp .  30-31).  Thus  the  components  of  the  bector  given 

in  Example  2.2(c)  and  the  components  of  the  vector  given  in  Example  2.6(c)  are 

associated.  (b)  Let  (E^.E^)  be  as  in  Example  2.6(e)  with  a>  0,  or  as  in  2.6(f) 

with  -1  £  a  <  0 .  Since  P{E^>x,  E2>y}<P{E^>x}P{E2>y}  for  x,y>  0,  E^  and  E^ 

are  not  associated.  (c)  Let  (X,Y)  be  as  in  Example  2.6(h).  Then  -ln[l-F(X)] 

and  -ln[l-G(Y)]  are  associated  if  and  only  if  X  and  Y  are  associated  (cf.  Barlow 

and  Proschan  (1975),  Proposition  3,  p.  30). 

The  following  lemma  provides  sufficient  conditions  for  some  of  the  bivariate 

distributions  presented  in  Examples  2.2  and  2.6  to  be  associated. 

Lemma  2.10.  Let  Q  =  (Q^.C^)  be  a  random  vector  with  components  assuming  values 

in  the  set  {1,2,...}  and  let  R(j)  =  (R^(j),  R2O))*  j=  1,2,...,  be  an  iid  sequence 

of  nonnegative  random  vectors  independent  of  Q.  If  Q.  and  Q  are  associated,  and 

^2 

R^  ( 1 )  and  R2(l)  are  associated,  then  ^  ^_^R^  ( j )  and  are  associated. 

2 

Proof:  Let  f,g:  R  -*■  R  be  measurable  bounded  functions  nondecreasing  in  each 

rQ,  _  q2 

argument  and  let  X  =  ^  ^R^(j)  and  Y  =  )j_^R^(j).  First  note  that 

cov{ f(X,Y) ,g(X,Y) }  =  E{cov(f(X,Y),g(X,Y)) |  Q } 

+  cov{ Ef (X , Y) | Q ,  Eg(X,Y) ;Q} . 
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Now,  Ef(X,Y)|Q  and  Eg(X,Y)|Q  are  nondecreasing  functions  of  and  .  Since 
and  are  associated  we  have 

cov{Ef (X,Y)  !q,  Eg(X,Y)  |Q}>_0. 

Now,  let  Q  =  max(Q  .  Since  f(X,Y)|Q  and  g(X,Y)|Q  are  nondecreasing  functions 

of  R^(l)  ,  .  .  .  ,R^(Q)  .R^d) ,  . . .  .I^CQ)  ,  these  random  variables  are  associated 
(cf.  Barlow  and  Proschan  (1975),  Theorem  2.2).  Thus 

cov{  f  (X,Y)  i  Q,  g(X,Y)  iQl^O. 

Consequently,  cov{ f (X,Y) , g(X,Y) } >_ 0  and  X  and  Y  are  associated.  □ 

Remarks  2.11  In  particular,  we  conclude  from  Lemma  2.10  that:  (a)  The 
components  of  the  bivariate  geometric  distribution  given  in  Example  2.2(e)  are 
associated  provided  that  M^  and  M2,  and  N^(l)  and  ^(1)  are  associated. 

(b)  The  components  of  the  bivariate  exponential  distribution  given  in  Example 
2.6(d)  are  associated  provided  that  M  and  N,  and  E^(l)  and  £2(1)  are  associated. 

3.  Model  Constructions 

In  this  section  we  construct  two  classes  of  finite  and  infinite  MA  sequences 
of  bivariate  random  vectors.  We  denote  the  first  class  of  sequences  by 
(X(n,m)  =  (X^ (n ,m) ,X2 (n ,m) ) ,  n=  0,+l,+2,...}  m  ■=  1,2,...,®,  and  the  second  class 
of  sequences  by  (G(n,m)  =  (G^(n,m),  G2(n,m))f  n  =  0,+l,+2,...}  m  =  1,2,...,®. 

We  show  that  each  random  vector  X(n,m)  has  a  bivariate  exponential  distribution 
with  a  vector  mean  that  does  not  depend  on  n  or  m  and  that  each  G(n,m)  has  a  bi¬ 
variate  geometric  distribution  with  a  vector  mean  independent  of  n  or  m.  Within 
each  class  of  sequences  the  order  of  dependence  on  the  past  is  indicated  by  the 
parameter  m.  For  each  positive  integer  m,  X(n,m)  and  G(n,m)  depends  only  on  the 
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previous  m  variates  {X(n-1 ,m) , . . . ,X(n-m,m) }  and  {G(n-1 ,m) , . . . ,G(n-m,m) } , 
respectively,  while  X(n,°°)  and  G(n,®)  depends  on  all  the  preceeding  random  vectors 
{X(n,l,*) ,X(n-2, }  and  {G(n-1 ,«°)  ,G(n-2 ,  respectively.  After  con¬ 
structing  the  various  models  we  present  sufficient  conditions  for  the  random 
variables  {X^fn^.m)}  and  {G^n^.m)},  l  =  1,2;  j  =  1,2, ...,k  to  be  associated, 
where  k  =  1,2,...,  and  <  n2  <  * ' * <  e  »•••)•  We  conclude  this  section 

by  computing  the  autocovariance  matrices  for  the  two  classes  of  sequences. 


First,  we  construct  the  exponential  class  of  sequences.  Some  notation  is 
needed . 

Notation  3.1.  Throughout,  n  ranges  over  the  integers  and  m,j  over  the  positive 
integers.  Let  E(n)  =  (E^(n) ,E2(n))  be  iid  bivariate  exponential  random  vectors 
with  mean  vector  ^1**2*^’  Let  (n , j )  and  82(0, j)  be  parameters  tak¬ 

ing  values  in  [0,1]  and  let  B(n,j)  be  a  2*2  diagonal  matrix  with  B(n,j)  = 
diag{ 8^ (n, j ) ,  82(n,j)}.  Further  let  (1^ (n , j ) , ^(n , j ) )  be  independent  bivariate 
random  vectors  independent  of  all  the  E(n)  such  that  Ij(n,j)  and  ^(n.j)  are 
Bernoulli  with  parameters  1-  8^(n,j)  and  1-  82(0, j),  respectively.  Let 

j  j 

V  (n,j)  be  a  2*2  random  diagonal  matrix  defined  by  V  (n,j)=  diag{  n  I  (n,k),  ~  I9( 
q  q  k=q  1  k=q  1 

q  c  {1,2,. . . , j  } ,  and  for  ease  of  notation  we  put  V^(n,j)=V(n,j).  Finally  let  a 

sum  (product )  over  an  empty  set  of  indices  be  equal  to  zero  (one) . 

We  now  present  the  class  of  exponential  sequences.  For  m=  1,2,...,  and 

n  =  0 ,  +1 , +2 .... ,  let 


(3.2)  X(n,m)  =  V“~QV(n, r) B(n,r+1 )E(n-r)  +  V(n,m)E(n-m) 

and 

0  3)  X(n ,°°)  =  Ir=0V(n,r)B(n,r+l)E(n-r)  . 


We  show  in  Corollary  3.8  and  Lemma  3.9  that 
bivariate  exponential  distributions.  Next, 


for  all  n,m,  X(n,m)  and  X(n,*)  have 
we  construct  the  geometric  class. 


Some  notation  is  needed. 


Notation  3.4.  Let  p1 ,  p 2  be  real  numbers  in  (0,1]  and  let  a^n)  and  a  (n)  be  a 
sequence  of  parameters  such  that  p^  <_  a  (n)  <_  1 ,  j  =  1,2.  Further,  let  N(n)  = 

(N. (n) ,N  (n) )  be  independent  bivariate  geometric  vectors  with  mean  vector 
(?1  P2  a2^n^  an<^  ^et  ^(n)  =  (M^(n),  F^Cn))  be  iid  bivariate  geoemtrics,  in 

dependent  of  all  N(n),with  mean  vector  (p^.p'1).  Finally,  let  (  J^n ,  j  )  ,  J  (n,  j  ) ) 
be  independent  random  vectors,  independent  of  all  M(n)  and  N(n),  such  that  J.(n,j) 
is  Bernoulli  with  parameter  (l-a.(n)),  i=l,2,  and  let  U  (n,j)  be  a  2-2  random 

j1  j  q 

diagonal  matrix  U  (n,j)  =  diag{  n  J  (n,k),  n  J_(n,k)},  qe  {1,2,. ...j}.  To  ease 
q  k=q  k=q 

the  notation  we  put  U  (n,j)  =  U(n,j). 

We  now  present  the  class  of  geometric  sequences.  ror  m=  1,2,...,  and 
n  =  0 ,  +1 ,+2 , . . . ,  let 


(3.5) 


G(n,m)  =  J™=QU(n, r)N(n-r)  +  U(n,m+l)M(n-m) 


(3.6) 


G(n ,“)  =  j r=QU(n,r)N(n-r) . 


Next,  we  show  that  X(n,m)  and  G(n,m)  have  bivariate  exponential  and  geometric 
distributions,  respectively.  The  following  lemma  is  needed. 

Lemma  3.7  For  n  =  0,+l,+2,...,  and  m,q  =  1,2,...,  let 


Y  (n,m)=  '  V  (n,r+q-l)B(n,r+q)E(n-r-q+l) +  V  (n ,m+q-l) E(n-m~q+l) 
-q  - r-u  q  q 


H^(n,m)  =  I”_0U  (n,r+q-l)N(n-r-q+l)+U  (n,m+q)M(n-m-q+l) 


Then  for  all  n,m,  and  q,  Y  (n,m)  has  a  bivariate  exponential  distribution  with 
1  1  ~q 

mean  vector  (>^  ^  )  and  H^(n,m)  has  a  bivariate  geometric  distribution  with  mean 

.  -1  -1, 

vector  (p  ,pn  )  . 


Proof : 


We  prove  the  result  of  the  lemma  by  an  induction  argument  on  m. 


For  m  =  1 , 

Y^(n,l) =  B(n,q)E(n-q+l) +  V^(n,q)E(n-q) 

and  for  m =  0 , 

H  (n,0) =  N(n-q+l) +  U  (n,q)M(n-q+l) . 

~q  q 

By  computing  the  characteristic  functions  of  the  components  of  Y  (n,l)  and 
H  (n,0)  one  can  verifv  that  the  results  of  the  lemma  hold  for  all  n,q.  Assume  now 

-q 

that  the  results  of  the  lemma  hold  for  m,  and  all  n,q,  Noting  that 

Y  (n,m+l) =  B(n,q)E(n-q+l)+  V  (n,q)[\m  nV  , , (n , r+q )B (n , r+q+1 ) E (n-q-r ) 

„q  q  r-u  q+i 

+  V  (n,  nr+q)  E  (n-m-q)  ] 
q+i 

and 

H  (n  ,m+l)  =  N(n-q+l)+U  ( n ,  q )  [Y  ™  U  (n  ,  r+q)  N  (n-q-r  ) 

_  q  ,  q  r=u  qn 

+  U  , , (n ,m+q+l )M(n-m-q) ] 

q+i 


we  see  that,  by  induction,  the  terms  in  the  brackets  are  bivariate  exponential 
with  mean  an^  bivariate  geometric  with  mean  (p^.p^1),  respectively. 

Since  these  terms  are  independent  of  E(n-q+l)  and  N(n-q+l),  respectively,  it  follow 
as  in  the  case  m=  1  and  m=0,  respec tivelv ,  that  Y  (n,m+l)  and  H  (n,m+l)  have  the 

,q  ~q 

appropriate  distributions  for  all  n  and  q.  □ 

Note  that  X(n,m)  and  G(n,m)  given  by  (3.2)  and  (3.5),  respect ivelv ,  are 
equal  to  Y^(n,m)  and  H^(n,m),  respectively.  Thus,  we  conclude  from  Lemma  3.7  that: 
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Corollary  3.8  For  all  n  and  m,  X(n,m)  has  a  bivariate  exponential  distribu¬ 
tion  with  mean  vector  and  G(n,m)  has  a  bivariate  geometric  distribution 

with  mean  vector 

Next,  we  show  that  G(n,°°)  given  by  (3.6)  is  bivariate  geometric,  and  if  for 
all  n  and  i  =  1,2 


(3.9) 


m 

lim  n  [1-6. (n,j  )J  =  0 
nr*=°  j  =  1 


then  X(n,®)  given  by  (3.3),  is  bivariate  exponential. 

Lemma  3.10.  (a)  For  all  n,  G(n,=°)  has  a  bivariate  geometric  distribution 

with  mean  vector  (p  ^.p^^).  (b)  If  condition  (3.9)  holds,  then  for  all  n, 

X(n,°c0  has  a  bivariate  exponential  distribution  with  mean  vector  (X^^.X^^). 

Proof :  Let  m  be  a  positive  integer.  Since  lim  [ 1-a . (n) ]m  <_  lim  (l-p.)m=0, 

nr*-°°  nr*00  ^ 

j  =  1,2,  G(n,m)  — 2— >  G(n,°°)  as  m-»- ®.  By  (3.9),  X(n,m)  — 2— >  X(n,°°)  as  m-*-  °°.  Thus 
in  particular  G(n,m)  — >  G(n,°°)  and  X(n,m)  — >  X(n,“)  as  nr™  and  the  results  of 
the  lemma  follow  from  Corollary  3.8,  □ 

Note  that  for  (3.9)  to  hold,  it  suffices  that  for  all  n  and  i=  1,2, 
inf{6^(n,j),  j  =  1,2,...}>  0.  Next,  we  investigate  some  of  the  dependency  aspects 
of  both  classes. 

Remarks  3.11.  (a)  For  fixed  m,  the  sequences  (X(n,m),  n=  0,+l,+2,...}  and 

{G(n,m),  n=  0,+l,+2,...}  are  m-dependent  (that  is,  if  n^  and  n^  are  integers  such 
that  In^-n^l  >  m,  then  X(n^,m)  and  X^^.m)  are  independent  as  are  G(n^,m)  and 
G(n  ,m)).  (b)  Clearly  if  we  choose  m  to  be  a  function,  say  i|,  of  n  with 

v(n)t  ;1,2,,..}  for  all  n,  then  the  dependency  of  X(n,C(n))  and  G(n,C(n))  on  the 
past  varies  with  n.  (c)  It  is  easy  to  see  that  for  all  n,  X(n,°°)  and  G(n,®)  de¬ 
pends  on  all  preceeding  random  vectors  [X(q,oc),  <  q  <  n)  and  {G(q,°°),  q  <  n}, 


respect i ve 1 y  , 


We  now  investigate  a  positive  dependence  aspect  of  both  classes. 

Lemma  3.12.  Suppose  that  E^(l)  and  E^(l)  are  associated.  Then  for  all 
positive  integers  m,k  and  all  integers  n^ <  n^ <  ...<  n^,  the  random  variables 
(X^n^.m),  i =  1,2;  j=l,...,k}  are  associated. 

Proof :  By  Barlow  and  Proschan  (1975,  Theorem  2.2,  p.  31  and  Proposition  4, 
p .  30)  the  random  variables  E^(n^),  1^ (n^ , q) ,  i =  1 , 2 ;  j  =  1 , .  . . ,  k ,  and  9  =  1 ,  .  ,  .  ,m 
are  associated.  Since  the  X^Cn^.m),  i=  1,2;  j=  l,...,k  are  nondecreasing  functions 
of  the  previous  collection  of  associated  random  variables  the  result  of  the  lemma 
follows  by  Barlow  and  Proschan  (1975,  Proposition  3,  p.  30).  □ 

In  a  similar  way  one  can  prove  the  following  lemma. 

Lemma  3.13.  Suppose  that  M^(l)  and  M^(l)  are  associated  and  that  for  all  n, 
N^(n)  and  N^(n)  are  associated.  Then  for  all  positive  integers  m,k  and  all 

integers  n^  <  n^  <  . . , <  ,  the  random  variables  (G.. (n^ ,m) ,  i =  1,2;  j  =  1 . k}  are 

associated . 


Now,  we  prove  similar  results  for  the  infinite  dependence  sequences 
{X(n,°°),  n=  0,+l,+2, .  .  ,  }  and  {G(n,°°),  n  =  0 ,+l  ,+2  , .  .  . } . 

Lemma  3 . 14  .  (a)Suppose  that  M^(l)  and  M^Cl)  are  associated,  and  that  for 
all  n,  N^(n)  and  N^(n)  are  associated.  Then  for  all  positive  integers  k  and  all 
integers  n^  <  n2  <  .  . .  <  n^,  the  random  variables  {G^(n^  ,<*>)  ,  i  =  1,2;  j  =  1 ,  .  .  .  ,k)  are 
associated.  (b)  If  E^(l)  and  E^(l)  are  associated  and  condition  (3.9)  holds 
then  for  all  positive  integers  k  and  all  integers  n^ <  n^ *  . . . <  n^,  the  random 
variables  {X^(n^  ,*  ) ,  i =  1 , 2  and  j  =  l,...,k)  are  associated. 

Proof:  By  similar  arguments  to  the  ones  given  in  the  proof  of  Lemma  3.10 

we  conclude  that  the  two  sequences  { G^ (n^ ,m) .G^ (n^ ,m) , . . . , G^ (n^ ,m) .G^n^ ,m) }  and 
•  X^ (n^ ,m) ,X^ (n^ ,m) , . . . ,X^ (n^,m) , X2 (n^ ,m) }  converge  in  distribution  as  m-*  «  to 
tG  (ni ,“) ,G2(ni ,<*),... ,Gi (Hk*®) ,G2(nk>^) }  and  {Xj  (nj  ,<*)  ,X2(ni ,«),...  ,Xj  (1^  ,<*)  ,X2  (n^  ,<*) 
respectively.  By  Lemma  3.12  the  random  variables  {X.(nJtm),  i=  1,2;  j=  l,...,kl  are 


associated  for  all  m  and  by  Lemma  3.13  the  {G^n^.m),  i=  1,2;  j=  l,...,k}  are 
associated  for  all  m.  Consequently,  the  results  of  the  lemma  follow  by  Esary, 
Proschan  and  Walkup  (1967,  Proposition  4).  □ 

Next,  we  compute  the  autocovariance  matrices  for  both  classes  of  sequences. 
Some  notation  is  needed. 

Notation  3.15.  Let  Z  ,  Z^,  and  E^,(n)  be  the  covariance  matrices  of  E(l),  M(l), 
and  N  ( n ) ,  respectively.  For  h=  0,1,2,...,  let  r%,h)  =  cov(X(n,m)  ,X(n+h,m) )  and 

-  A  „  ^ 

:”(n,h)  =  cov(G(n,m),  G(n+h,m)),  n  =  0,+l,+2,...,  and  m  =  1,2,...,®.  Further, 
let  A(n,j)  be  a  2><2  diagonal  matrix,  A(n,j)  =  diag{  [  1-c^  (n)  ] J  ,  [ l-;^  (n) ] J  } ,  I  be 
the  2'2  identity  matrix,  and  x  the  indicator  function. 

By  some  simple  calculations  we  obtain  for  n =  0 ,+l ,+2 , . . . ;  m=  1 , 2  , .  .  .  ,«,  and 
h  =  1,2,...  (but  not  zero) } 

h  1  r  r+h 

(3.16)  F®(n,h)-  lm  "■iB(n,r+l){  n  [l-B(n,j)D  E_{  n  [I-B(n+h,j  )  ]  }B(n+h,r+h-l) 

X  r=°  j-1  E  J-l 

m— h  m 

+B(n,m-h+l){  n  [ I-B(n , j ) ) }  5  {  n  [I-B(n+h,j) ]}. 

j-l  j-l 

We  may  obtain  the  off-diagonal  elements  of  r®(n,0)  from  (3.16)  by  setting  B(n,m+1) 

A 

and  h  =  0.  The  diagonal  elements  of  F™(n,0)  are  the  variances  of  X. (n,m)  and 

A  1 

-2  -2 

X^n.m)  ,  namely,  and  »  respectively.  In  a  similar  way  we  obtain  for 
n  =  0,  +l,+2,...,  m  =  1,2,...,®,  and  h  =  1,2,...  (but  not  zero), 

m-h 

(3.17)  r°(n,h)  =  lr=QA(n,r)  E  (n-r) A(n+h , r+h) 

+x{0}(h)A(n>n*1)HMA(n’m+1) • 

We  may  obtain  the  off-diagonal  elements  of  F^(n  ,0)  from  (3.17)  by  setting  h=  0  ; 

G 

_  o 

the  diagonal  elements  are  the  variances  of  G^(n,m)  and  G^Cn.m),  namely,  (l-p^)p^‘ 
_2 

and  (1-p  )p„  ,  respectively. 


4.  Inequalities 


Throughout  this  section  we  fix  m,  m  =  1,2,...,*,  and  hence  suppress  it  from 
cur  notation,  that  is,  X(n,m)  and  G(n,m)  are  represented  by  X(n)  and  G(n)  ,  re¬ 
spectively  . 

In  the  point  process  theory  of  the  models,  the  behavior  of  the  vector 

r . 

of  sums  S  (r)  =  (S  (r  ) ,  S  (r  ))  where  S  (r.)  =  V  1  X  (n) ,  i=  1,2  and 
„X  -  A.  l  X0  2  a  i  -n=l  l 

1  2  1  ri 

T  (r)  *  (T  (r.),  T  (r.))  where  T  (r  )  =  ]  G.(n),  are  of  interest,  r. ,r 

^G  ^  G^  1  G2  ^  G^  i  wn— 1  1  1  1 

For  example,  if  X(n)  is  a  vector  of  bivariate  exponential  interarrival  times  of  a 
point  process  M^(t)  =  (M^  (t^),M^  which  are  the  number  of  arrivals  by  times 

tl,t2>  then 


P{MX1(tl)-rl’  ^  (t2)-r2}  =  P(SX  (rl):>  V  SX  (r2}>  t21' 

1  2  1  2  * 

Similarly,  if  G(n)  is  a  vector  of  bivariate  geometric  waiting  times  of  a  count 

process  N  (r)  =  (N  (r.),N  (r„))  which  are  the  number  of  occurrences  by  trials 
~G  G.^  G2  ^ 

r1,r2=  1,2,...,  then  N£  (rj  -  i  *  1,2. 

We  now  utilize  positive  dependence  properties  to  obtain  probability  bounds  for 
the  sums  S  (r)  and  T  (r)  and  moment  inequalities  for  the  processes  X(n)  and  G(n). 
First,  we  define  two  concepts  of  positive  dependence. 

Definition  4,1  Let  q  =  2,3,...,  and  let  X  =  (X^,..,,X  )  be  a  random  vector.  We  say 
that  X  is  positively  upper  orthant  dependent  (PUOD)  [positively  lower  orthant 
dependent  (PLOD)]  if  for  all  real  numbers  tj,...,t 


P{  > 


n  p  i  x .  >  t 
J-i  J 


j 


[p{x  <  t  ,  j 


q 

1 , . . . ,  q  }  >_  n  pU  it.}]. 
j=i  J  J 


Remarks  4.2.  (a)  In  the  bivariate  case  (q=2)  X  is  PUOD  iff  X  is  PLOD. 

(b)  For  q>  2  the  two  concepts  of  positive  dependence  are  not  equivalent.  (c)  If 

X,  ,...,X  are  associated  then  clearly  X  is  PUOD  and  PLOD.  (d)  Let  f,,...,f  : 

1  ||  *  1  q 

(_aotac)->  [0,°°)  be  measurable  nondecreasing  (nonincreasing)  functions  and  let  X  be 
PUOD  (PLOD) .  Then 

q  q 

(A. 3)  E  n  f  (X  )>_  n  Ef  .  (X . ) 

j=l  J  J  j=l  J  J 

(see  Lehman  (1966)).  For  the  sake  of  completeness  we  present  the  following 
definition. 

Definition  A. A  Let  X,Y  be  random  variables.  We  say  that  X  is  stochastically  less 

5 

than  or  equal  to  Y,  and  write  X  <  Y  is  for  every  real  number,  t  ,P(X> t)  _<  P (Y>t)  . 

Remark  A . 5 .  Let  f:  (-•,«>) -»■  [O,00)  be  a  measurable  nondecreasing  function  and 

let  X  £  Y.  Then  Ef(X)<_Ef(Y)  (see  Lehmann  (1966)).  * 

Next,  we  discuss  the  inheritance  of  positive  dependence  properties. 

Lemma  A ,  6 .  Suppose  that  for  q  =  1,2,...,  the  random  variables  {X_^(n),  i=  1,2; 

n=  l,2,...,q}  are  associated  and  the  random  variables  {G^(n),  i=  1,2;  n=  l,...,q] 

are  associated.  Then  for  rl5r9  =  1,2,...,  and  t1,t_>  0  we  have  that  (i){S  (r.),i=l,2 

i  a  i  t  a  .  i 

1 

are  associated,  (ii)  {T  (r.),  i=  1,2}  or  equivalently  {N  (r.),  i=  1,2}  are  asso- 

G .  1  G .  l 

l  l 

ciated  and  (iii)  {M  (t.),  i=  1,2}  are  PUOD  and  PLOD. 

Xi  1 

Proof:  Parts  (i)  and  (ii)  follow  from  the  facts  that  S„  (r_. )  and  T„  (r.), 

■  A  ,  l  G  .  l 

1  1 

i=  1,2,  are  nondecreasing  functions  of  associated  random  variables  (cf.  Remark  2.9a). 
To  show  (iii),  let  f.  =  > { S  (r . )  >  t . }  and  g .  =  \ [ S  (r . )  ^  t . } ,  i =  1 , 2,  where  .  is 

1  X.l  1  1  A.l  1 

1  1 

the  indicator  function.  By  Barlow  and  Proschan  (1973,  Proposition  3,p.  3'0 ,  f 


and  g  ,  i  =  1,2  are  associated  since  S  (r.),  i-1,2, 
i  x.l 


are  associated.  Hence  by  (A.  3), 
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P  { M  ( t  )  >  r .  ,  1=1,2}  *  E  n  f  ._>  n  Ef .  =  n  P{M  (t  )  >  r  } 
Xi  11  i-1  1  i=l  1  i-1  Xi  1  1 


2  2  2 

P  { M  ( t . )  <_  r  .  ,  i  =  1,2}  =  E  n  g.  >_  n  Eg.  =  n  P  { ( t . )  <_  r  .  } 
i  1=1  1=1  i=l  l 


For  the  stationary  models,  we  may  obtain  bounds  for  sums  S  (r)  and  T  (r) 

%  A  s  ^  (_J 

using  gamma  and  negative  binomial  distributions,  respectively.  First,  we  concen¬ 
trate  on  S^(r). 

Lemma  4.7.  Assume  that  B^(n,l)  and  f^Cn.l)  are  equal  to  and  S2,  respectively 

for  all  n.  Let  Y.(r.,$^),  i=  1,2,  be  gamma  random  variables  with  parameters  (r  ,r^)> 
S  “1 

Then  S  (r.)  _>  Y.(r.,>  .6.  ),  i=  1,2.  If  in  addition,  the  random  variables 

X  .  1  1111 

1 

{X.(n),  i=  1,2;  n*  l,...,q},  q=  1,2,.,,,  are  associated,  then  for  x^»x2> 

(4.8)  P(SX  (r2)>  x2,Sx  (r2)ix2}lP^I(r1,X1B“1)  ^  x2  }P{Y2(r2  .^B"1)  1  x2} . 

Proof :  From  equation  (3.2)  and  (3.3)  we  see  that  (n)  B^E^ (n) ,  i=  1,2. 

Hence 


r . 

r  i  v 


p{S  ( r . )  >  x . }  =  P{'  X . (n) >  x . 
X.  l—i  ^n=l  l  -  l 


r . 

>P{5  1  6 .E  (n)  >  x  ) 
—  Ln=l  i  l  —  l 


=  P{Y.(r. ,X.B  ) >  x.  },  i =  1,2, 
1111—1 


and  the  first  assertion  is  proved.  Equation  (4,8)  now  follows  from  the  first 
assertion  and  the  fact  that  since  S  (r.)  and  S  (r  )  are  associated  (Lemma  4.6) 

Xj  l  X£  ^ 

they  are  also  PUOD.  □ 

In  a  similar  manner  we  obtain  the  following  lemma  for  the  sums  T  (r). 

Lemma  4.9.  Assume  that  s  (n)  and  a2(n)  are  equal  to  0^  and  a 2,  respectively, 
Let  NB ,  ( r  .  ,  "3.  i=  1,2,  be  negative  binomial  random  variables  with 


for  all  n. 
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-1, 


parameters  (r  ,?  ).  Then  T  (r  )  >_  NB  (r  ,p  a.  ),  1*1,2.  If  in  addition,  the 

1  1  1  1111 


random  variables  {G^(n),  i=  1,2;  n=  l,...,q},  q*  1,2,...,  are  associated,  then 


for  a^ _>  r^  and  a^^r^, 


(4.10)  P{Tg  (r1)ia1,T(;  (r2)  1  )  1  P(NB1  (^  .p^"1)  >  }P{NB2  (r2  .p^"1)  >  a2  } 


Proof : 


From  equation  (3.5)  or  (3.6)  we  have  that  G^(n)^N^(n),  i=  1,2; 


n  =  1,2,....  Hence 


r . 


>  P{7  1.N.  (n)  >  a.  } 
-  - n=l  l  —  i 


-1, 


=  P{NBi(ri,pia1i)>  a^,  i-1,2, 


and  the  first  assertion  is  proved.  Equation  (4.10)  now  follows  from  the  associa¬ 


tion  of  T  (r.)  and  T  (r„) .  □ 

Gj^  1  G2  2 


Finally,  we  address  ourselves  to  some  moment  inequalities. 


Lemma  4.11.  Let  us  assume  that  the  random  variables  (X^n),  i=  1,2;  n=  l,...,h 


h=  1,2,...,  are  associated.  Let  k^,...,k  be  positive  integers  and  let  £^,£2,...,£ 


1,2;  q  =  l,2,...«  Then 


q  ki  q  — k  j 

E  n  {X0  (1)}  J  >  n  {k  : [ X  ]  J}. 

j=l  J  3-1  J 


Proof :  The  result  follows  by  Corollary  3.8  and  the  association  of  the  random 


vairables  {X.  (n)  ,  j=  l,...,q}.  □ 


j 


Lemma  4.12.  Let  us  assume  that  the  random  variables  {G  (n),  i=  1,2;  n=  l,...,h 


h=  1,2,...,  are  associated.  Let  k,,...,k  be  positive  integers  and  let  £,,£»,... 

1  q  i  <- 


1,2;  q-1,2,....  Then 
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